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Amendments to the Claims 

Please amend Claims 38, 40-41, 55, 60-62. Please add new Claims 63 and 64. The 
Claim Listing below will replace all prior versions of the claims in the application. 

Claim Listing 

1 . (Withdrawn) A method for automatically processing a representation of a multimedia 
presentation having multiple information streams contained therein, the method 
comprising the steps of: 

(a) matching observed event cues detected within at least one information stream of 
the multimedia presentation with a model of expected event cues for a class of 
presentations to which the specific multimedia presentation belongs; and 

(b) selecting presentation segments of the multimedia presentation based upon the 
results of matching observed event cues with the model of expected event cues. 

2. (Withdrawn) A method as in Claim 1 wherein the step of selecting presentation segments 
is implemented using a finite state machine having the expected event cues as state 
transitions. 

3. (Withdrawn) A method as in Claim 1 wherein the expected event cues comprise a 
plurality of time difference based cues. 

4. (Withdrawn) A method as in Claim 1 wherein the expected event cues comprise a 
plurality of intrastream cues taken from a given information stream. 

5. (Withdrawn) A method as in Claim 1 wherein the expected event cues comprise 
interstream cues taken from more than one information stream, and the step of selecting 
presentation segments comprises correlating the interstream event cues. 
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6. (Withdrawn) A method as in Claim 1 wherein the expected event cues are taken from a 
text information stream, 

7. (Withdrawn) A method as in Claim 6 wherein the expected event cues are closed 
captioned word cues. 

8. (Withdrawn) A method as in Claim 6 wherein the expected event cues are closed 
captioned punctuation cues. 

9. (Withdrawn) A method as in Claim 6 wherein the expected event cues are token phrases 
for the class of multimedia presentation. 

10. (Withdrawn) A method as in Claim 9 wherein the token phrases comprise text strings. 

1 1 . (Withdrawn) A method as in Claim 9 wherein the token phrases comprise closed 
captioned punctuation cues. 

12. (Withdrawn) A method as in Claim 1 1 wherein the close captioned punctuation cues are 
selected from the group consisting of "»", "»>", and 

13. (Withdrawn) A method as in Claim 9 wherein the token phrases comprise a named entity 
and a text string. 

14. (Withdrawn) A method as in Claim 13 wherein the token phrases include "I'm" followed 
by a <person> named entity. 

15. (Withdrawn) A method as in Claim 9 wherein the token phrases comprise a named entity 
and a closed captioned punctuation cue. 
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16. (Withdrawn) A method as in Claim 1 5 wherein the token phrases include a <person> 
named entity followed by a ":". 

17. (Withdrawn) A method as in Claim 9 wherein the token phrases comprise introductory 
news broadcast terms. 

18. (Withdrawn) A method as in Claim 17 wherein at least one token phrase is selected from 
the group consisting of Tin", "hello", "welcome", "hello from", "welcome to", "thanks 
for watching", "thanks for joining us", and "here on". 

19. (Withdrawn) A method as in Claim 9 wherein the token phrases comprise anchor to 
reporter hand-off phrases. 

20. (Withdrawn) A method as in Claim 19 wherein at least one token phrase comprises a 
reporter named entity. 

21 . (Withdrawn) A method as in Claim 19 wherein at least one token phrase is selected from 
the group consisting of a station identification with a reporter named entity, a reporter 
named entity with the phrase "joins us", and a reporter named entity with the phrase 
"reports". 

22. (Withdrawn) A method as in Claim 9 wherein the token phrases comprise reporter to 
anchor hand-off phrases. 

23. (Withdrawn) A method as in Claim 22 wherein at least one token phrase is selected from 
the group consisting of a station identification with a reporter named entity, a reporter 
named entity with a located named entity, "back to you", and "thank you". 



24. 



(Withdrawn) A method as in Claim 9 wherein the token phrases comprise leaders to 
highlights of upcoming news stories. 
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25. (Withdrawn) A method as in Claim 24 wherein at least one token phrase is selected from 
the group consisting of "coming up", "next on", "ahead on", "when" together with a 
station identification and "returns", and "also ahead". 

26. (Withdrawn) A method as in Claim 9 wherein the token phrases comprise sign off 
phrases. 

27. (Withdrawn) A method as in Claim 26 wherein at least one token phrase is selected from 
the group consisting of "that wraps up", "that is all", "that's all", "that's" together with a 
news program identification, "thanks for watching", and "thanks for joining us". 

28. (Withdrawn) A method as in Claim 6 wherein the expected event cues are named entities. 

29. (Withdrawn) A method as in Clam 28 wherein the named entities are selected from the 
group consisting of persons, locations, organizations, times, dates and monetary values. 

30. (Withdrawn) A method as in Claim 1 wherein the model of expected event cues is 
developed from observed event cues occurring in a class of media presentations. 

3 1 . (Withdrawn) A method as in Claim 28 wherein the model of expected event cues is 
developed by statistical analysis of observed event cues. 

32. (Withdrawn) A method as in Claim 1 wherein the expected event cues are taken from an 
image information stream. 

33. (Withdrawn) A method as in Claim 32 wherein the expected event cues are selected from 
the group consisting of black frame, logo frame, single anchor frame, double anchor 
frame, and reporter frame. 
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34. (Withdrawn) A method as in Claim 1 wherein the expected event cues are taken from an 
audio information stream. 

35. (Withdrawn) A method as in Claim 34 wherein the expected event cues are selected from 
the group consisting of silence detection, speaker change detection, and jingle detection. 

36. (Withdrawn) A method as in Claim 1 wherein the expected event cues are indications of 
news stories. 

37. (Withdrawn) A method as in Claim 34 wherein the expected event cues are selected from 
the group consisting of before start of broadcast, start of broadcast, highlight segment, 
advertising, story start, story end, before end of broadcast, and end of broadcast. 

38. (Currently Amended) A method as in Claim [[59]] 61 further comprising the steps of: 

(e) extracting text information from a text information stream corresponding to the 
story segment as text data; 

(f) extracting story summary data from the text data; and 

(g) linking together a stored representation of the text data, summary data, and named 
entity data for the story segment. 

39. (Previously Presented) A method as in Claim 38 wherein the method additionally 
comprises the steps of: 

(f) storing the representations of the text data, summary data, and named entity data 
for story segments as one or more files on a file server computer connected to a 
computer network; and 

(g) allowing access to the stored representations of news story segments available to a 
browser program running on at least one client computer connected to the 
computer network. 

40. (Currently Amended) A method as in Claim [[59]] 61 further comprising the steps of: 
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(e) extracting story summary data using the named entities as a basis. 

41 . (Currently Amended) A method for automatically processing a representation of a 
multimedia presentation having multiple information streams contained therein, the 
method comprising the steps of: 

(a) selecting at least one contiguous portion of the multimedia presentation as a story 
segment; 

(b) extracting named entities from a text information stream corresponding to the 
story segment; 

[[©)]] (c)using extracted named entities as search criteria to select from among a plurality 
of story segments; and 

(d) in response to a search query, presenting a list of named entities and their 
corresponding number of occurrences in story segments over a selected time 
period; and 

(e) extracting story summary data using the named entities as a basis, 

wherein the step of extracting story summary data additionally comprises the steps 
of: 

(i) determining a frequency of occurrence for the named entities per sentence in a 
story segment; and 

(ii) selecting a sentence with a greatest named entity frequency of occurrence as a 
topic sentence. 

42. (Previously Presented) A method as in Claim 41 wherein step (ii) of selecting a sentence 
additionally comprises the step of: 

(iii) if more than one sentence has a greatest named entity frequency of 

occurrence, selecting the sentence closest to the beginning of the story as 
the topic sentence. 
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43. (Previously Presented) A method as in Claim 41 wherein step (a) of selecting at least one 
contiguous portion of the multimedia presentation as a story segment, additionally 
comprises a step of: 

matching a model of expected event cues with observed event cues in at least one 
information stream. 



44. (Previously Presented) A method as in Claim 41 further comprising the step of: 

(f) selecting a key frame from an imagery stream in the multimedia presentation 
representative of the segment based upon the type of segment. 

45. (Original) A method as in Claim 44 wherein the story segment contains a reporter 
segment and the key frame is selected from the middle of the reporter segment. 

46. (Original) A method as in Claim 44 wherein the story segment contains an anchor booth 
segment and the key frame is selected from the middle of the anchor booth segment. 



47. (Previously Presented) A method as in Claim 59 further comprising the steps of: 

(e) in response to a search query, selecting multiple contiguous portions of the 
multimedia presentation as story segments; and 

(f) in response to a search query, presenting a summary display having multiple 
summary presentation elements representative of the extracted story segments. 

48. (Original) A method as in Claim 47 wherein the summary presentation elements from a 
given story segment are displayed together. 

49. (Previously Presented) A method as in Claim 48 wherein the summary presentation 
elements comprise extracted named entities. 

50. (Original) A method as in Claim 48 wherein the summary presentation elements comprise 
summary sentences. 
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5 1 . (Original) A method as in Claim 48 wherein the summary presentation elements comprise 
a hyperlink to a source media element of the segment. 

52. (Previously Presented) A method as in Claim 48 wherein step (f) of presenting a summary 
display additionally comprises the step of: 

presenting extracted named entities in a hypertext link form such that hyperlinks 
lead to presentation of additional elements of the story segment. 

53. (Previously Presented) A method as in Claim 47 wherein step (f) of presenting a summary 
display additionally comprises the step of: 

in response to a search query for a selected named entity, presenting a thumbnail 
view comprising key frames from multiple story segments containing the selected named 
entity. 

54. (Previously Presented) A method as in Claim 47 wherein step (f) of presenting a summary 
display additionally comprises the step of: 

in response to a search query for a story segments of a selected type, presenting a 
thumbnail view comprising key frames from multiple story segments of the selected type. 

55. (Currently Amended) A method as in Claim [[59]] 61 additionally comprising the steps 
of: 

(e) extracting information from at least one information stream corresponding to the 
story segment as source data; 

(f) extracting a summary representation of the story segment from the source data; 
and 

(g) presenting a plurality of related story segments using a layered hierarchical 
presentation of the summary representations at a relatively high hierarchical level 
and the source data at a relatively low hierarchical level, together with hyperlinks 
permitting navigation among related story segments to a desired hierarchical level 
of representation. 
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56. (Previously Presented) A method as in Claim 55 wherein the information stream is a text 
stream, the source data is text relating to a story segment, and the summary representation 
includes extracted named entities. 

57. (Original) A method as in Claim 55 wherein the information stream is an image stream, 
the source data is image data for the complete story segment, and the summary 
representation is a key frame. 

58. Canceled. 

59. (Withdrawn) A method for automatically processing a representation of a multimedia 
presentation having multiple information streams contained therein, the method 
comprising the steps of: 

(a) selecting at least one contiguous portion of the multimedia presentation as a story 
segment; 

(b) extracting named entities from a text information stream corresponding to the 
story segment; 

©) using extracted named entities as search criteria to select from among a plurality 
of story segments; and 

(d) in response to a search query, presenting a list of named entities and their 
corresponding number of occurrences in story segments over a selected time 
period. 

60. (Currently Amended) A method as in Claim [[59]] 61 additionally comprising the step of: 

(e) in response to a search query, presenting a graph of named entities and their 
corresponding frequency of occurrences in story segments over a selected time 
period. 
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(Currently Amended) A method for automatically processing a representation of a 
multimedia presentation having multiple information streams contained therein, the 
method comprising the steps of: 

(a) selecting at least one contiguous portion of the multimedia presentation as a story 
segment; 

(b) extracting named entities from a text information stream corresponding to the 
story segment; 

[[©)]]{c)using extracted named entities as search criteria to select from among a plurality 
of story segments; 

(d) in response to a search query, presenting named entities and their corresponding 
number of occurrences in story segments over a selected time period, the 
presenting of named entities in a form of a graph of a view of named entities and 
their corresponding frequencies of occurrences in story segments over a selected 
time period ; and. . 

fe) in r es p onse to selection of a point on the g r aph of nam e d e ntities, p r esenting the 

user with an overview of story segments containing th e s e l e cted named entity. 

(Currently Amended) A method as in Claim [[59]] 61 additionally comprising the step of: 
fg)(f) in response to a search query for a story segments of a selected type, presenting a 

thumbnail view comprising key frames from multiple story segments of the 

selected type. 

(New) A method as in Claim 61 wherein the step of presenting named entities and their 
frequency of occurrences over a selected time period further comprises presenting 
the view of named entities as a graph. 

(New) A method as in claim 63 additionally comprising: 

(e) in response to selection of a point on the graph of named entities, 

presenting the user with an overview of story segments containing the 
selected named entity. 



